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© Noise reduction filter. 



© In a noise reduction filter comprising a weighted average filter (1A) coupled to receive a plurality of input 
signal samples (O,©) and furnishing noise-reduced signal samples, and a delay circuit (3A) which is coupled to 
an output of the weighted average filter (1A) and which furnishes a plurality of delayed noise-reduced signal 
samples (X) to a further input of the weighted average filter (1A), weighting coefficients assigned to samples of 
said input signal (O) and said delayed signal (X) depend on respective differences between a current sample (©) 
of said input signal on the one hand and said samples of said input signal (O) and said delayed signal (X) on the 
other hand. 
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the' invention relates to' a noise' reduction filter; more particularly to a filter for image data noise 
reduction. The invention also relates to a hoiise reduction filtering methpd and to an image signal receiver 
f comprising a noise reduction filter. ' . v »; 

Noise reduction of image data is generally realized through averaging of likely* correlated picture 

5 elements. The likelihood may be due to spatial or temporal proximity. Both linear and non-linear filters have 
been used for noise reduction purpds^s.as weil'as'thV intermediate solution of adapting filter Coefficients to 
local picture statistics. 5 

5 The article "Extended-Order Statistic" Filter ahS ; Evaluation of Noise Reduction Performance", Electron- 
ics and Communications in Japan, Part 3, Vol. 74, No. 5, 1991, pp. 1-1 i, discloses an extended-order 

10 statistic filter for image data noiSe redaction!" TO linear 
filters is that in ' an OSF/ weighting" 6oeffi spatial or tempbral distance with 

respect to* the currenVsdrnpl^, but to'thib ordeFdf 'th^Va baSis of their signal 

vaiue: In the extended^rder st^ the cbefficients not ohfy' depend oh the 

order of the signal values, but also on the order ? 6f differences between the signal values of neighboring 

15 samples and the signal value of the current sample (differential OSF), and further on the distance to the 
current sample. It was shown that this type of filter can combine the advantages of linear and non-linear 
filtering on -gaussian noise ^and impulse-noise, respectively .The transversal nature of these filters makes 
them rather expensive when applied to profit from the temporal correlation in image sequences. 

It is, inter alia, an object of the invention to provide a filter which is more cost-effective. For this 

20 purpose, a. first aspect of the invention provides a noise reduction filter as defined in claim 1. A second 
/'aspect of " the* ' invention! ' provides 'an . image Signal' receiver as ' defined in claim 12. A third aspect of the 
" invention provides a noise reduction i filtering claim 13. Advantageous embodiments' of 

' the invention are defined iri the ; * 

' trie noise reduction' filtbr dbfiri^d in cfairh 1' shows an improved hard warie efficiency when compared 5 to 

25 the filter described in the above-mentioned article, since no ranking of the ' filter input samples or of 
differences between filter input samples and a current sample is required. One of, the recognitions 
underlying the present invention is that in an OSF, the ranking of the input Samples anti thus th£ weighting 
coefficients assigned to these input samples, may result in high weighting cbefficients assigned to samples 
showing a large difference with regard to the current sample just because there were no samples showing a 

30 smaller ; differehcei* with : regarcrto* the" 'current "saTfi'ptel '¥He ; VWcursive%an6versal Weighted average filter in 1 
accordance with the present invention, in which the weighting coefficients depend on the differences 
between a current input sample and neighboring samples, does not show this disadvantage. Experiments 
have showrvthat an attractive price/performance*^ television receivers is yielded, where 

its performance is certainly superior to that of currently used motion-adaptive temporal filters. 

35 It is noted that JP-A-2/67,688 shows an image noise removing system in which, to prevent the' 5 *' 
generation of blur, filter characteristics are based on a relation between a central pixel and a weighted 
averaged pixel ih ! the case of filtering a r pixel' positioned oh th^ ; boundary of blocks: A weighted average of a 
central pixel and eight neighboring pixels surrounding the central pixel is determined. If the difference 
between the central pixel and the weighted average is smaller than a threshold, the weighted average is 

40 supplied, whereas when the difference exceeds .Jthe, threshold, .the, u nfi I tered ; central pixel is supplied. In 
contradistinction with the present invention, the prior* art weighted average is in no way influenced by the 
differences^ between the neighboring pixejs , andjhe, central pixel. In the prior art, the choice between the 
weighted average pixel and the unfiftered '"central pixel is a hard decision, while according to the present 
invention, for each neighboring pixel a -separate decision is. taken as to whether and to what extent it 

45 participates in the weighted average! The present invention thus offers a far more gradual adaptation to 
local image characteristics. 

Further, DE-C-39.27.101 shows a noise reduction filter in which a delayed luminance signal and an 
undelayed luminance signal are only averaged if their difference is smaller than a given value. This 
corresponds to the noise removing system of JP-A-2/67,688 if instead of eight neighboring pixels 

so surrounding the current pixel, only one neighboring pixel above the current pixel would be present. All ' 
disadvantages of the system of JR-A-2/67,688 are still present; in fact, the circuit of DE-C-39.27.101 can be 
considered as a primitive embodiment of the system of JP-A-2/67,688. \ 

The article "Symmetrical recursive; median filters; application to noise reduction and edge detection", 
by Ph. Bolon et al., Signal Processing V: theories and applications, pp. 813-816 shows a recursive median 

55 filter for noise reduction. A median filter is :a specieslof the class of order statistic filters. The symmetrical 
filter described in the article, shows the disadvantage that for two-dimensionally filtering a current input 
pixel, information from the "future" (i.e. pixels below the current pixel when the pixels are scanned from top 
to bottom) is required, which is unattractive in view of a hardware realisation. In contradistinction therewith, 

2 
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in the embodiment of. claim 2 information from horizontal, lines other, than the line on which, the current pixel 
lies is taken from the output of the delay circuit in the recursive .noise reduction circuit. ... 

These and other aspects of the invention will be apparent from and elucidated with reference to. the 
embodiments described hereinafter. , , , >v ,. vV ; . tM „ . 
5 In the drawing: % , ., . v ... : . - , 

.Figs.. 1 A and 1B show block diagrams '[of*emi^\fnpife..Q& a^noise reduction filter in accordance with the 
present invention; and • 
Fig. 2 shows a block diagram of a.pteferr^.diffe^ average filter for use in the 

noise reduction filters of Rg. 1 v , ; - * .oH ,fnV .r. u< j . . ? ? : ;" • : i 

10 The. invention concerns non-linear recursive, s^ Experiments indicate jiiat 

the. filters are attractive for .use in future television jeceivj9r.s, -as /their performance is certainly superiorrto 
that of the presently used rnotipn-adaptive^ filters, .while their complexity- ,is practically 

equivalent r Fqr, every, pixel .position. a ^j^*^^^ luminance signal 

. F(p^, the/proposed filter p . . . . 

„ ; ...... . . f r ..■••••<.• ™« ■■■ -v • . . •> u> 

where A/i and Afe are sets : of vectors defining .ppq^p^or tridimensional .neighborhoods.,.. The recursiyity 
.... of the filter results from the third term of 'equation .(1^ the amount of 

recursivity. Further, in accordance with the present inventfbn,.,and. jn r ip^tr^i^rK^<^..to .an l( Q$F or a 
differential OSF. filter weighting, coefficients «.(/>.., n)^en6 n)^are ; l^ejated , to th"e ? 'absolute difference 
25 between, the 'weighted .'pixel, arid the currenfinpu^pix^!, ; ^. V} C/Ts ^ ft<£ . .. , . :( . «. 

a(p,/7x = /i(t,F(p) - % + nj|j ," s : ■< 

; i(p, n) = fe(j/(P) T fc<ft>. 5)1).;; i X2) : V^^'vr:- ,ii T ^ . • ,v - ; '..w , 

30 j with 1\ and/2 monotonously .decreasing functions. J^^jj^on^p^.G^isa^g^n or. normalization factor: . 
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An ''attractive implementatipn results itthe^jltei.w'ej^^^ , ; v' 
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while selecting W = 0:25> 77te ! =- , 4lT/if£ J rtd-->C J, = A 8 ,rf — 1s where 77)! was adapted to" the noise level. As can 
be seen from - equations (6) and (7), the neighborhoocis are selected such that pipe-lining of the algorithm 
implemented in a very large scale ihteg • ' ■»-.*.' , 

When allowing for field memories in* J the^ design, ^a three-dimehsional noise reduction filter : can' -be 
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where D(x, t) = (D x , D y ) T is the displacement vector describing the motion between field at time t and the 
previous field at time f-7, while selecting W = 0.25, Th 2 = 4.777i, and T = 5 = 1, where Tfa was adapted 
'to the noise level as" will be dis6ussed ? b3low. In ^equation (9), T is the field period of the video signal, which 
equals 20 ms in a 50 Hz environment. Obviously, if no motion vectors are available, D(k, t) can be taken 0. 
Again, as can be seen from the equations (9) and (10), the neighborhoods are selected taking implementa- 
tion aspects, pipe-lining of the algorithm, into account. To obtain both spatial and temporal recursion, the 
set~/V 2 r may be the union of the sets given in the equations (7) and (9). 

The basicldea of the filter is' illustrated in Fig: T. In . thelhoise reduction filters of Figs. 1A and 1B, the 
input to the difference-dependent weighted average calculation circuit 1 A;- 1B includes the current sample e 
and several neighboring samples O and X, as in the prior art order statistic filter, but in accordance with the 
present invention, part of the neighboring samples O and X are previously filtered samples X. In an image 
processing system, the delay of the delay circuit 3A, 3B in the feeclback v loop may be a line period (Fig. : 
1B), a field period or a picture period (Fig. 1A), plus or minus some pixel delays. When the delay is a field 
or picture period, the feedback loop preferably includes a motion compensation circuit to obtain a better 
matching of the pixels on which the recursive noise reduction filtering is based. Fig. 1A shows an 
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embodiment of an interfield noise reduction filter in which the delay of the delay circuit 3A is a field or a 
picture delay, so. that the neighboring fed-back pixels, X may, originate from both above and. below the. line 
comprising the current pixel ©; the left and right adjacent pixels O are from. the same line and field; as the 
current pixel ©. Fig. 1B shows an embodiment of an intrafield noise reduction filter in which the delay of the 
5 delay circuit 3B is a line delay, so that the neighboring fed-back pixels X originate from the line above the 
line comprising the current pixel e; the left and right adjacent pixels O are from the same line as the current 
pixel e. 

An attractive implementation of the difference-dependent -weighted average calculating circuit is given in 
Fig. 2. The differences of all pixels in the filter window N1 plus N2 (in, Fig. 2 indicated as Pni .. Pn n ) with 

w respect to the current input sample Pc, are calculated by subtracters 5 and absolute value determining 
circuits 7, and compared with a threshold Thi by comparators 9. The pixels for which the difference with 
the current sample is below the threshold Thi, are averaged and the result is applied to the output of/the 
noise reduction filter which is also the input of the delay circuit. 

This action is carried out by multiplexers 11 controlled by the comparators 9 to furnish a weighting 

rs coefficient 0 when the difference is above the threshold Thi and to furnish a weighting coefficient a when 
the difference is below the threshold Thh. Multipliers ;13 'multiply the neighboring pixels Pn with their 
respective weighting coefficients. The circuit \ot Fig. 2j\$ somewhat simplified with regard to equation (4): 
those differences between the neighboring pixelj values 'Pn, and the, current pixel value Pc which are smaller 
than the threshold Thi result in a coefficient a for-the corresponding neighboring pixel value Pn, while the 

20 differences exceeding the threshold value Thi result in a coefficient 0 for the corresponding neighboring, 
pixel value Pn. The current sample Pc is added to the ^veig hted. neighboring pixels Pn by adders ,15; wr^ose 
output signals are summed by an adder 17. The output HoMhe. adder 17 ; is. multiplied by a gain coefficient to 
yield the output signal of the difference-dependent; weighted ;'^yeragerfilte/.. When a equals 1, ^simple 
average is used; when a differs from 1, a. weighted av^jagej soused. t; n r .r : v • * • : * 

25 Rather than,, applying binary, valued, coefficients^ only, th^ee . or four different, coefficient .values (alpha 1 , 
2....n) can be applied, where the coefficients with the smallest value are assigned using the highest 

threshold (Thi , Th2 Th n ). Further as indicated in equation (2), the weights for previously filtered pixels 

can be selected different (j8 rather than a). 

As mentioned hereinbefore, the threshold 777i (and therefore also Ifa,, which has a fixed relation to 

30 Thy) is preferably adapted to the noise level. A global adaptation (i.e. ari. adaptation for a whole picture) can 
be thought of and indeed proved useful. Hereinafter, a somewhat more': sophisticated option adapting to 
local image characteristics is described. To this end, the -image is divided into non-overlapping blocks B- 
(X), where X = (X, Y) J is the center of the block. To each block a value of 77)i is assigned, the calculation 
of which is based upon the 7/?i value in the previous field (temporal recursive adaptation process): 
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77MX t) = 77MX f - 7) - A(X, f) (10) 

with: ■ i - { . . ... i ? i> , I j ) C , ?. ? ' O ■ . Ti ~ 1>] 



A(X, t) = Ci . / £ I F f(K + 2, i-T) - F(X + x, t-T) | - MinMad(t) V (H) 



4&* t <\. -s ■. • , • .\ . • --•!/' J:. - * \:r\ -;.>v- .v s \ » > t \^ - . A:A ';^-\yi.- < 

where MinMad is an estimated value, of the noise level in. the ; field, and Gi: is ,a constant. A possible 
... simplification is to use a sign function according -to: - t v :; . \ r . •;. , n r;\ -.^ ;.H • ■? n\ > 1 v - 

; • ,-!.• • ■■■ ' !■■*.- ■ x-: -.. j i*> '?v^-v - J w : • -v , '•«■:.«/•. 

0 ,= C^ SIGN/ | F^ +;2,;/rr) r F(X ^,; t-T) \ - MinMad{t)\ ^) 
55 where SIGN(a) is defined according to: / : . a. 4 : ,-;»r/ n •« - ? rl? r*^'i?.'j ivi.:^.'-.*"-*; 
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Experiments showed that MinMad(t) is preferably equal to the minimum in a field at time f of the motion- 
compensated summed absolute difference over a blockjof two successive fields: 



MinMod(t) = Min £ | F(x 9 t) - F{x - D(X y t) y t - 7) | (14) 



where D(X t t) is the displacement vector found with a motion estimator for the block fi(X) at time f. The 
75 philosophy behind this choice is that MinMad(t) thus reflects the noise in the picture assuming that the 

estimator at least at one block of the image is boh verged completely. 

In an attractive implementation, the motion- estimator and the noise reduction circuit would share the 

picture memories, which is possible because the sum in] equation (14) corresponds to the match error of the 

motion estimator. In this situation, however, the measured MinMad{t) corresponds to the reduced noise 
20 , level, which is preferably corrected for the amount of filtering applied. Experimentally, it was verified that the 

following correction, the result of which is'tcaUtid^MbtiMadft); yields 'satisfactory results: ! 

ModMad(f) - ModMad(t 



25 where Mod(t) \s found according to 



(16) 



35 



where 0(X) is the block' where. MinMad(i) was 1 found; while Oi and C3 again are experimentally optimized 
>/ /c'onkahts/The first' time ModMad(tf\s ca\6u\aieS^M6dmad(t J T) is' Assumed to be zero.' 

/ : / Bather than adapting \ Th\ per block 'in the 'picture,' or additional to 'it, local adaptation of 7 and 5 in 

* equation (1) can be considered- ' ' /' / r ; ; ! ^ ^ - y ' - '" " ^ v. 

J if should be noted thai the ■above-mentioned embodiments 'illustrate rather than limit the invention, and 
that those skilled in the art will be able to design many alternative embodiments without departing from the 
40 scope of the appended claims. 

As an alternative to the use of the recursive noise reduction filter of Fig. 2 using all neighboring samples 
which differ by less than a (noise adapted) threshold from the current pixel value, it is possible to average 
the n least differing (compared to the current pixel) pixel values, in which case h depends on the noise 

45. / In ^ a /television; 'signal_ receiver having/ a\iummanc^ noise reduction filter and a chrominance noise 
reductidn filter/" filter coefficients of the- chrominance noise reduction filter are preferably dependent on 
differences between neighboring luminance pixel values. This yields as an unexpected advantage that 
/ cross-color is reduced. This effect can be explained/ as follows. Suppose an e.g. horizontal high-frequency 
//luminance pattern/ The horizohtai/high^ ah undesired cross-color 

50 having verticaj components. To avbid'that the horizontal high-frequency information will be damaged by the 
noise reduction filtering, the noise reduction filtering will be predominantly vertically oriented. Such a 
vertically oriented noise reduction filtering will not only filter the vertical noise components, but also the 

* vertical cross-color components and thus red uc : e the cross-color 

A further improvement "is obtained when instead of directly neighboring input pixels, pixels at some 
55 horizontal and/or vertical distance are used. It appeared that thereby, low-frequency noise components were 
reduced in addition to the high-frequency noise components which can also be reduced when directly 
/ neighboring input pixels are. used. In one preferred' embodiment,' the recursive noise reduction filter receives 
5 filtered' pixels from the previous line having a distance of 4 pixels between two Successive input' pixels, 3 
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unfiltered pixels from the present line having a distance of 2 pixels between two successive input pixels, 
/.e., instead of the. neighborhoods A/i and Afe indicated Jn the formulae (6) and (7), the following 
neighborhoods are used: . • ; 
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A ringing effect occurring at edges .appeared^to^J^e .re^upiBd,; wh^n^ ,the : filtered. ' input sample? from the 
previous line (neighborhood Afe) were taken from positions shifted in the horizontal direction line-aiternatin- 
gly by + 1, 0, -1, 0, +1, ... pixels. Many variations in the ; inter : pixeMistance. the number, of pixels used, 
and the magnitude of the line-alternating shift in the position of the filtered input pixels taken from the 
previous line are possible. In one embodiment, the inter-pixel distance depends, on an edge-detection such 
that the inter-pixel distance decreases with an increasing difference between a current pixel and one of the 
neighboring pixels (e.g. the neighboring pixel having the largest distance to the current pixel). The inter- 
pixel distance may vary separately for left and right neighboring pixels. 

Thus, in accordance : with the present invention, /a .family* of, non-linear r . filters is proposed, which 
experimentally shows a particularly good suitability for noise reduction application in image data processing. 
It concerns a class of recursive spatial and spatio-temporal filter?, for which options are given to adapt to 
noise level and local image characteristics. In the noise reduction filters in accordance with the present 
invention, weights are related to the absolute difference between samples. It is shown that particularly multi- 
dimensional, recursive variants of th i is, i nonli near .filter, family are attractive for npise.reduction of irnages. v .The 
recursivity can be designed to_ facilitate implementation, at hi processing ^sr^ed^Ae. ,th§ defimtion pf .the 
noise reduction filter allows for .pipe-lining. In" case pf temporal "recursion, motion-cpmp^ but to 

increase the performance. An attractive ' implementation ' of the weight cajpulatipn circuit [is, prpviped, and 
methods .are indicated to adapt the filter to the. rjoisie leyeL ? jn J; th^ picture and'^o thej,^ of 
'. the picture. v . - . x- 
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Claims < .,- ,■...751^; Vl ru;s-,^ ■» a- a-- 1 m\ -i; 

1. A noise reduction filter comprising: . ' . v . lV ^ ^ .. , . ;J . , . ' r : ti .-^:r:^- -* «: 

delay means (3) for furnishing a plurality of delayed signal samples (X); . 
. a weighted average filter ,(1) coupled to receive a plurality of input signal samples (O,©) and said > 
delayed, signal samples ; (X) ; to furnish npise-reduced, signaj samples to !said te delay me^, (3),„ and 
. . , wherein' ,.. r . r -. ... , ; . .-_.-„.. . r .* .- ; . .. . t y ■ r>\-'\. 

; weighting coefficients assigned to samples ; (Pni..Pn n ). of .said input signal (O) and said I delayed 
signal (X) depend on respective differences, between {& current sarnplp (e.Pc) of said input signal on the 
one hand and said samples (Pni 7 Pn n ) of . said! input signal ^O) and Said delayed signal 0?) on, trie .other. 
„.,„ hand % > . ■ . • ■• „ .- ■ :■■.■) *.■,■■.>;•■»",• . * r r*t t. v v "v». r 

2. A noise reduction filter as claimed in claim 1,' wherein said plurality of input samples areJaH on a 
first horizontal line of an image signal, while said. .delayed signal samples fW t jre ; all dri^ppe of more 

. : Jines other than said first horiiontal^ line. \ . . ,. v v y ;. !r ».?y!.-.,i ! 

3. A noise reduction filter as claimed in f claim 1 t wherein a v first weighting . coefficient is v ^ssigned to 
^ . samples' (Pni ..Pn n ) of said input signal (O) and^said delayed signal ;(X^ 
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value from said current 
said first weighting coefficient 
delayed signal (X) differ ng 
input signal. 



A noise reduction filter 
first weighting coefficien 
(e.Pc) by more than 
which second threshold 
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A noise reduction filter 
field of a motion 



A noise reduction filter 
noise reduction filtering 



9. 



A noise reduction filter ajs 
average filter (1) are not-directly 



samples depends on an 



sample (e.Pc) of said input signal, while weighting coefficients differing from 
are assigned to samples (Pni ..Pn„) of said input signal (O) and said 
by more than said threshold value from said current sample (e.Pc) of said 



claimed in claim 3, wherein a second weighting coefficient smaller than said 
is assigned jb~ttio& samples (Pni ..Pn n ) which differ from the current sample 
first-mentioned threshold value and by less than: a second threshold value, 
value is larger than said first threshold value. 



5. A noise; reduction "filter as claimed in' "dlfiinrT'ir wherein said delay means (3) "comprise motion vector 
compensation means. 

6. A noise reduction filter a > claimed in claim 3, wherein said threshold value depends on the noise level. 



ajs claimed in claim^3, I whVreiri' , saTd threshold value-depends on aminimum in a 
comper sated difference between two successive fields. 



as 



claimed in claim 1, wherein , weighting coefficients for a chrominance signal 
depend on differences between neighboring luminance sample values. 



claimed in claim 1, wherein said samples (Pni..Pn n ) applied to said weighting 
neighboring samples. 



25 10. A noise reduction filter as claimed in claim 9, wherein a distance between ^said not-directly neighboring 



edge-detection* such that said distance decreases with an increasing difference 



between a current sample (©.Pc) and one of said ^riot-directly neighboring samples. 
11. A noise reduction filter* as claimed in claim 1^ wherein j^iaicl ^delayed samples (X) from a previous line 



are taken from positions 



j samples (Phi ..Pn n );of said input signal (O) and said delayed signal (X) on the 
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line-alternatingly shifted in the horizontal direction. 



12. An image signal receiver comprising a signaj input for receiving an irinage signal, a signal processor for 
processing said image !>ignal f , and a display unit for displaying the processed image signal, wherein 
said signal processor comprises a noise reduction filterfas claimed in any r of the preceding claims. 

13. A noise reduction filtering method comprising the steps of: 
furnishing (3) a plurality of delayed signal samples (X); 

assigning weighting coefficients to samples (Pni^Pnp) 'of 1 an input signal (O) and said delayed 
signal (X) in dependence on respective differences ('between i.a current sample (e,Pc) of said input signal 
on the one haricl and sai 
other hand; and 

weighted average Altering' (1) a plurality of said input signal samples (O,©) and said delayed signal 
samples (X) by means of said weighting coefficients to furnish noise-reduced signal samples to said 
delayed signal samples (X) furnishing step (3). 
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